en
每月不到10元,就可以无限制地访问最好的AIbase。立即成为会员
Home
News
Daily Brief
Income Guide
Tutorial
Tools Directory
Product Library
en
Search AI Products and News
Explore worldwide AI information, discover new AI opportunities
AI News
AI Tools
AI Cases
AI Tutorial
Type :
AI News
AI Tools
AI Cases
AI Tutorial
2024-07-10 16:41:51
.
AIbase
.
10.2k
Google Unveils Million-Expert Mixture to Unlock Further Potential of Transformers
The Million Experts Mixture model proposed by Google DeepMind, a revolutionary study that has taken a significant step forward in the Transformer architecture. Imagine a model capable of sparse retrieval from a million mini-experts - doesn't that sound a bit like a science fiction novel plot? Yet, this is the latest research achievement from DeepMind. The core of this research is a highly parameter-efficient expert retrieval mechanism, which separates the computation cost from the parameter coun